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CO-CHANNEL INTERFERENCE CANCELLER 

BACKGROUND 

The present invention relates to data communication systems. In 
particular, the invention relates to all areas where channel estimators and 
5 equalization methods are used in digital communication. The invention discloses 
methods and systems for detecting and rejecting a co-channel interferer. The 
invention is particularly suitable for mobile or base stations in cellular 
communication systems, but its application is not limited to them. 

The cellular telephone industry has made phenomenal strides in commercial 
10 operations in the United States as well as the rest of the world. Growth in major 

metropolitan areas has far exceeded expectations and is rapidly outstripping system 
capacity. If this trend continues, the effects of this industry's growth will soon 
reach even the smallest markets. Innovative solutions are required to meet these 
increasing capacity needs as well as maintain high quality service and avoid raising 
15 prices. 

In order to increase the capacity in modern Time Division Multiple Access 
(TDM A) cellular systems, such as Global System for Mobile Communication 
(GSM) or Enhanced Data rate for GSM Evolutions (EDGE), the cells are 
decreased in size. This reduction of size implies that the capacity will be 

20 interference limited and not sensitivity limited, because near co-channel interferer s 
will dominate the noise figure (i.e., the amount of noise added in a received signal 
by the environment). Therefore, a significant portion of the noise received by a 
* receiver will not be due to white noise. However, when designing a conventional 
receiver for a TDM A system, for instance in a mobile phone, the disturbance is 

25 often modeled as white noise. Thus, conventional receiver design is optimized for 
the sensitivity limited case and not for the interference limited case. 
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Referring to Fig. 1, a block diagram of a conventional TDMA receiver is 
shown. The received signal is down-converted, filtered, A/D converted and 
sampled at a symbol rate in the front end receiver (Fe RX) 10. The output from 
the Fe RX 10 can mathematically be written according to: 



5 where H = [h 0 ,...,hJ T is a complex-valued vector representing the radio channel, 
U t = [u t ,...,u t _J T is a complex-valued vector representing the transmitted symbols 
(for instance 8-Phase Shift Keying (PSK)), and e t is some kind of noise often 
assumed to be white. The received burst is fed to a synchronization and channel 
estimator unit (Channel Est.) 12 that correlates the received burst, containing a 

10 known symbol pattern (i.e., a training sequence) within the burst, with the known 
training sequence in order to find the synchronization position (i.e., the position 
within the received burst at which the training sequence starts). After the 
synchronization position is found, a channel estimation is performed in order to 
estimate the radio channel taps H . Standard estimation techniques, such as 

15 Least-Squares and the like, can be used to obtain the channel estimate. These 

techniques are well known in the art. The received burst, the estimated channel H 
and the synchronization position are then fed to an equalizer 14 that detects the 
transmitted symbols. Conceptually, the equalizer 14 tries to find the symbols 
minimizing the following: 
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where S represent the symbol constellation (i.e., the set of symbols define for the 
given type of modulation, such as 8-PSK). The output from the equalizer is the 
decided hard symbol, the residuals given as: 

L 

e , = y t 12 hA-t 

k=0 



and a soft value, representing the uncertainty of the symbol estimate. The above 
5 described systems are well known in the art (see, J. Proakis, "Digital 
Communications", McGraw-Hill Inc., New York, 1995). 

The prior art systems do not provide for a co-channel interference-limited 
scenario (i.e., where the noise e t is not white). Therefore, there is a need for an 
efficient method to detect and reject a co-channel interferer. 

10 SUMMARY 

It should be emphasized that the terms "comprises" and "comprising", 
when used in this specification, are taken to specify the presence of stated features, 
integers, steps or components; but the use of these terms does not preclude the 
presence or addition of one or more other features, integers, steps, components or 

15 groups thereof. 

The current invention overcomes the prior art limitations by providing a 
method and apparatus for processing a received signal containing a desired burst 
and a co-channel interferer burst. The invention comprises receiving the received 
burst from a front end receiver. A time offset between the desired burst and the 

20 co-channel interferer burst is detected. Then, a detection procedure is selected 
based on the time offset between the desired burst and the co-channel interferer 
burst. Preferably, one of three detection procedures is selected based on the 
scenario detected and optionally the signal strength of the co-channel interferer 
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burst. For instance, if a training sequence of the desired burst and a training 
sequence of the co-channel interferer burst significantly overlap each other (i.e., a 
first scenario), then a joint detection procedure is selected and performed. If the 
training signal of the co-channel interferer burst significantly overlaps the desired 
5 burst (i.e., a second scenario), then an iterative detection procedure is selected and 
performed. Finally, if the training signal of the co-channel interferer burst has 
little or no overlap with the desired burst (i.e., a third scenario) or in some 
embodiments, if the co-channel interferer has a low signal strength compared to a 
signal strength of the desired burst, then a conventional (i.e., non-co-channel 
10 interference canceling) detection procedure is selected and performed. 

The above features and advantages of the present invention will be more 
apparent and additional features and advantages of the present invention will be 
appreciated from the following detailed description of the invention made with 
reference to the drawings. 



15 BRIEF DESCRIPTION OF THE DRAWINGS 

The objects and advantages of the invention will be understood by reading 
the following detailed description in conjunction with the drawings in which: 

Fig. 1 shows a conventional TDM A receiver structure; 

Fig. 2 shows a general radio communication system in which the invention 
20 can be implemented; 

Fig. 3 A shows a first time offset between the desired burst and the co- 
channel interferer burst; 

Fig. 3B shows a second time offset between the desired burst and the co- 
channel interferer burst; 
25 Fig. 3C shows a third time offset between the desired burst and the co- 

channel interferer burst; 
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Fig. 4 shows a receiver structure having a co-channel interference 



canceller; and 



Fig. 5 shows a flowchart illustrating a method of the invention for co- 
channel interference canceling. 



DETAILED DESCRIPTION 



In the following description, for purposes of explanation and not limitation, 
specific details are set forth, such as particular circuits, circuit components, 
techniques, and the like in order to provide a thorough understanding of the 
present invention. However, it will be apparent to one skilled in the art that the 
10 present invention may be practiced in other embodiments that depart from these 
specific details. In other instances, detailed descriptions of well-known methods, 
devices, and circuits are omitted so as not to obscure the description of the present 
invention. 



15 embodiments. To facilitate an understanding of the invention, many aspects of the 
invention are described in terms of sequences of actions to be performed by 
elements of a computer-based system. It will be recognized that in each of the 
embodiments, the various actions could be performed by specialized circuits (e.g., 
discrete logic gates interconnected to perform a specialized function), by program 

20 instructions being executed by one or more processors, or by a combination of 
both. Moreover, the invention can additionally be considered to be embodied 
entirely within any form of a computer readable storage medium having stored 
therein an appropriate set of computer instructions that would cause a processor to 
carry out the techniques described herein. Thus, the various aspects of the 

25 invention may be embodied in many different forms, and all such forms are 
contemplated to be within the scope of the invention. For each of the various 
aspects of the invention, any such form of an embodiment may be referred to 



The invention will be described in connection with a number of exemplary 



herein as "logic configured to" perform a described action, or alternatively as 
"logic that" performs a described action. 

The exemplary radio communication systems discussed herein are based 
upon the time division multiple access ("TDMA") protocol, in which 
5 communication between the base station and the mobile terminals is performed 

over a number of time slots. However, those skilled in the art will appreciate that 
the concepts disclosed herein find use in other protocols, including, but not limited 
to, frequency division multiple access ("FDMA"), code division multiple access 
("CDMA"), or some hybrid of any of the above protocols. Likewise, some of the 
10 exemplary embodiments provide illustrative examples relating to the GSM or 
EDGE type of systems; however, the techniques described herein are equally 
applicable to radio communication systems operating in accordance with any 
specification. 

Prior to discussing exemplary embodiments according to the invention, 
15 Fig. 2 will now be described which illustrates a general radio communication 

system 100 in which the invention can be implemented. The radio communication 
system 100 includes a plurality of radio base stations 170a-n connected to a 
plurality of corresponding antennae 130a-n. The radio base stations 170a-n in 
conjunction with the antennae 130a-n communicate with a plurality of mobile 
20 terminals (e.g., terminals 120a, 120b, and 120m) within a plurality of cells 

1 lOa-n. Communication from a base station to a mobile terminal is referred to as 
the downlink, whereas communication from a mobile terminal to the base station is 
referred to as the uplink. 

The base stations are connected to a Mobile Switching Center ("MSC") 
25 150. Among other tasks, the MSC coordinates the activities of the base station, 
such as during the handoff of a mobile terminal from one cell to another. The 
MSC 150, in turn, can be connected to a public switched telephone network 160, 
which services various communication devices 180a, 180b, and 180c. Both the 
mobile terminals 120a, 120b, and 120m, and the base stations 170a-n can 



incorporate the co-channel interference canceling system structures and techniques 
according to the invention. 

The invention provides methods and systems for detecting and rejecting a 
co-channel interferer (CCI) in a communication system, such as the GSM system, 
5 EDGE system, and the like. The type of interference rejection technique 

implemented is based on one or more factors including but not limited to the signal 
strength of the CCI and the relative time offset between the desired signal and the 
CCI. For instance, the interference rejection techniques can be based on joint 
detection or iterative techniques. An example of a joint estimation technique is 
10 found in U.S. Patent No. 5,937,015, entitled "Interference Mitigation by Joint 

Decoding of Overlapped Signals," which is incorporated by reference herein in its 
entirety. Optionally, a modulation detection of the CCI is performed before the 
detecting procedure. 

In the following description of the invention, reference numbers will be 
15 maintained between drawings where the items referenced are the same. Therefore, 
reference numbers for a particular figure may not be discussed where the 
information provided would be redundant. 

In a co-channel interference-limited scenario the noise e t is not white. 
Assuming one dominant interferer, a model of the received signal is given as: 

y t = E V^ + E**V* = H T U+G T V t (3) 



20 where G is the radio channel of the co-channel interferer and V t is a vector of 
symbols transmitted by the co-channel interferer. Therefore, if the co-channel 
interferer is detected and canceled (i.e., by estimating G and Vand subtracting the 
interferer from the received signal), a performance gain is obtained for the system. 
Figs. 3 A - 3C show three conceptually different scenarios regarding the 

25 time offset between the desired burst and the CCI. In Fig. 3A, a first scenario is 



# 



shown where a CCI burst 312 is almost synchronized with the desired burst (DB) 
310. The CCI burst 312 and DB 310 are received at the antenna almost at the 
same time. A major part of the CCI training sequence (TS) overlaps the training 
sequences (TS) of the DB (i.e., about 50% to 100% overlap of the training 
5 sequences). 

In Fig. 3B, a second scenario is shown where the training sequences of the 
CCI burst 322 and DB 320 are not significantly overlapping each other. However, 
there is significant overlap of the CCI burst 322 and DB 320. Generally, in the 
second scenario, the training sequence for the CCI burst 322 ranges from less than 
10 about 50% overlap of the training sequence DB 320 to greater than about 50% 

overlap of DB 320 (i.e., more than half of the training sequence of the CCI burst 
322 is present during the desired burst 320). A previously transmitted CCI burst 
324 only slightly overlaps the DB 320, because of the time offset between DB 320 
and CCI burst 324. 

15 In Fig. 3C, a third scenario is shown where a training sequence of CCI 

burst 332 is outside or almost outside DB 330. Generally, in the third scenario, 
the training sequence of the CCI burst 332 ranges from less than about 50% 
overlap of the DB 330 (i.e., less than half of the training sequence of the CCI 
burst 322 is present during the desired burst 320) to no overlap of DB 320, Also, 

20 there may be a significant overlap of a previous CCI burst 334 with DB 330. One 
skilled in the art will appreciate that the three scenarios are determined by the 
relative occurrence of the training sequence of the CCI to the desired burst. In 
accordance with an aspect of the invention, the techniques used to detect the co- 
channel interferer are selected based upon these three scenarios. 

25 Fig. 4 is a block diagram of an exemplary embodiment of a receiver that 

addresses all three scenarios. Different detection techniques are used for different 
scenarios. Each different scenario will be described below in relation to the 
section of the receiver that is selected by control unit (C.U.) 410. The received 
signal is down-converted, filtered, A/D converted and sampled at a symbol rate in 
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the front end receiver (Fe RX) 10. Assuming the desired signal is disturbed by a 
co-channel interferes the output (i.e., the received burst) from the front end 
receiver 10 can mathematically be written as shown in equation (3). In order for 
the receiver to detect and cancel the co-channel interferer (CO), it needs to 
5 estimate the CCI radio channel (i.e., G) in addition to detecting and estimating the 
desired radio channel (i.e., H). However, a joint channel estimation and detection 
are not always possible because the desired burst and the CCI burst are not 
necessarily synchronized (i.e., the bursts do not arrive at the same time at the 
receiver's antenna). Therefore, the detection procedure employed by the receiver 

10 depends on the time offset between the received bursts. Thus, the control unit 
(C.U.) 410 selects the detection procedure based on the time offset between the 
desired burst and the CCI burst. The time offset is defined as a difference between 
a coarse synchronization position for the desired burst and synchronization 
position for the CCI burst. For instance, the synchronization position for the 

15 desired burst may be based on the synchronization position from the last burst or 
alternatively may be based on the synchronization position for the present burst. 
The synchronization position for the CCI burst may be based on Time of Arrival 
(TO A) information. 

Alternatively, the synchronization position for the CCI burst may be based 

20 on a long time correlation. Equation (4) below describes one exemplary standard 
correlation relationship which may be used in conjunction with other steps to effect 
a synchronization technique for a long time correlation (e.g., for each burst do a 
correlation between the received burst and the training sequence): 

N 

Cjik) = £>W*, r5 » *=0,...,h>-1; y = l,...^ (4) 

TS 

where y ( is the received signal at time /, u are the training sequence symbols 
25 with the total number of training sequence symbols being N 9 w is the number of 
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synchronization search windows, and NB is the number of bursts over which the 
long time correlation is averaged. The energy for each time-lag k can then be 
computed as: 

«/*) = Ic/*)| 2 ■ 

The average energy over NB bursts is then calculated as: 

^ eik) 
average[e(k)] = > — . 

5 The synchronization position is then calculated as: 
Sync. P os. = max average[e(k)] . 



Additional techniques are described in U.S. Patent Application No. 09/722,749, 
filed on November 28, 2000 entitled "Using Different Channel Models for 
Different Training Sequences," which is incorporated by reference herein in its 
entirety. However, one skilled in the art will appreciate that there are many 

10 methods to determine synchronization positions and that the invention is not 
limited to a particular method. 

In the first scenario (see, e.g., Fig. 3A), a joint detection procedure is used 
because of the overlap of the training sequences of the CCI burst and the desired 
burst. The received burst containing the training sequences of the desired burst 

15 and the CCI burst are fed to a joint channel estimator unit (Joint Ch Est) 422. The 
joint channel estimator unit 422 correlates both training sequences with the 
received signal to find an exact synchronization position and then jointly estimates 
the radio channels H and G. The joint channel estimation is performed using 
standard Least-Squares techniques or other estimation techniques known in the art. 

20 The estimated channels together with the received signal are then fed to an 
equalizer (joint detection) 424 that jointly detects the desired and interfering 
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symbols. The output from the equalizer 424 is the decided hard symbol, u, the 
residuals, given as: 

L L 

e t = y, * A-* ~£ * A-* 

jfc=0 k=0 

and a soft value, representing the uncertainty of the symbol estimate, u r 

In the second scenario (see, e.g., Fig. 3B), an iterative detection scheme is 
5 used because of little or no overlap of the CCI training sequence with the training 
sequence of the desired burst. First a conventional detection of the desired burst is 
performed (i.e., standard synchronization and channel estimation) in the channel 
estimation unit (Ch. Est.) 432. Then, the channel estimate H , the synchronization 
position (sync, pos.) and the received signal are fed to an equalizer 434. The 
10 equalizer 434 uses the channel information to make a first estimate of the 
transmitted signals, w. The residuals e„ given as: 

L L 
*=0 Jk=0 

where e t represents a noise due to possible erroneous decisions of u n are output 
from the equalizer 434 to another channel estimation unit 436 that estimates the 
CCI radio channel based on the CCI synchronization information and the CCI 

15 training sequence. A second channel estimation (i.e., to estimate the CCI channel 
G) is performed, for example, using standard Least-Squares techniques or other 
estimation techniques known in the art. Then, the estimated CCI channel, G , is 
fed back to the equalizer 434. The equalizer 434 then performs a joint detection of 
the desired symbols and the CCI symbols, based on the estimated channels H and 

20 G over a part of the desired burst disturbed by the CCI burst. Outside the part 
disturbed by the CCI burst (e.g., between x and y as shown in Fig. 3B), an 
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updated conventional equalization is performed. The output from the second 
detection stage is the updated decided hard symbol, u, the residuals and a soft 
value, representing the uncertainty of the symbol estimate. 

In the third scenario (see, e.g., Fig. 3C), a majority of the CCI training 
5 sequence is outside the desired burst. Therefore, it is very difficult to estimate the 
CCI radio channel because little or no CCI training sequence data is available 
during the desired burst. Preferably, the control unit 410 decides not to perform 
any co-channel rejection. Therefore, the decoding procedure will be based on 
conventional synchronization, channel estimation and equalization procedures as 

10 describe in relation to Fig. 1. Optionally, if the signal strength of the CCI is low 
compared to the signal strength of the desired burst, the control unit 410 will 
decide not to perform any co-channel detection. For example, in EDGE, if the 
carrier to interference ratio (C/I) is greater than 20 dB, then only conventional 
synchronization, channel estimation and equalization procedures are used. 

15 Referring to Fig. 5, a flowchart illustrating an exemplary method of the 

invention is shown. The method starts by receiving a received signal from a front 
end receiver, in step 510. The received signal contains both a desired burst and a 
co-channel interferer burst. In step 520, a time offset between the desired burst 
and the co-channel interferer burst is detected. Then, in step 530, a detection 

20 procedure is selected based on the time offset between the desired burst and the co- 
channel interferer burst. Preferably, one of three detection procedures is selected 
based on the time offset detected and optionally the signal strength of the co- 
channel interferer burst. For instance, in step 540, if the training signal of the co- 
channel interferer burst has little or no overlap with the desired burst (i.e., a third 

25 scenario as illustrated in Fig. 3C) or if the co-channel interferer has a low signal 
strength compared to a signal strength of the desired burst, then a conventional 
detection procedure is selected and performed in step 545. In step 550, if the 
training signal of the co-channel interferer burst significantly overlaps the desired 
burst (i.e., a second scenario as illustrated in Fig. 3B), then an iterative detection 
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procedure is selected and performed in step 555. An exemplary iterative detection 
procedure was described above with respect to blocks 432, 434, and 436 in Fig. 4. 
Finally, in step 560, if the training sequence of the desired burst and the training 
sequence of the co-channel interferer burst significantly overlap each other (i.e., a 
5 first scenario as illustrated in Fig. 3A), then a joint detection procedure is selected 
and performed in step 565. 

The foregoing has described the principles, preferred embodiments and 
modes of operation of the present invention. However, the invention should not 
be construed as being limited to the particular embodiments discussed above. For 

10 example, in the EDGE system, the modulation for the desired burst and the CCI 
burst are not known in advance and can vary between bursts. Therefore, a 
modulation detection must occur before the channel estimation and equalization 
procedure. Thus, a modulation detection has to be performed on both the desired 
signal and the CCI. The modulation detection is performed by correlating training 

15 sequences for all possible modulations with the received burst in the 

synchronization stage and then selecting the modulation that provides the best 
correlation result. One skilled in the art will appreciate that there are many 
modulation detection techniques well known in the art and that the invention is not 
limited to a particular technique. 

20 Additionally, the invention can be extended to more than one CCI. For 

instance, assume two CCIs (i.e., CCI-1 and CCI-2). The number of possible burst 
overlap scenarios is then increased to nine, as shown in Table 1. Although the 
number of combinations increases, the process is similar to that described above 
for the single CCI case. Specifically, the type of detection procedure used (i.e., 

25 joint, iterative, or conventional) for each CCI burst is determined by the scenario 
detected. Therefore, using the coarse synchronization positions of each CCI burst, 
a time offset between the desired burst and each CCI burst can be determined. 
The appropriate detection procedure is then selected based on the time offset 
between the desired burst and each CCI burst. For instance, as shown below in 
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cases 1-3, if the scenario detected is the same (i.e., the time offset of both CCI-1 
and CCI-2 is about the same) then the detection procedure selected will be the 
same. However, as shown in cases 4-9, if the scenario detected is different (i.e., 
the time offset of both CCI-1 and CCI-2 is not the same) then the detection 
5 procedure selected will be different for each CCI. 
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Table 1 

One skilled in the art will appreciate that the number of CCIs processed can 
be further expanded and is not limited to two. Additionally, as noted above a 
conventional detection scheme may be selected on any of the CCI's based upon 
10 that CCI's signal strength (i.e., if the CCI's signal strength is low compared to a 
signal strength of the desired burst). 

Therefore, the above-described embodiments should be regarded as 
illustrative rather than restrictive, and it should be appreciated that variations may 
be made in those embodiments by workers skilled in the art without departing 
15 from the scope of the present invention as defined by the following claims. 



